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Abstract 



Tho Lister Hill K^periniciitnl Computrr ■ 
Assi.stcd Instruction Network has biM^n in bi»inj; 
since July 1972* II It^s connccLtd three uni- 
versity data bases to as many as W usinj; 
institutions. The paper presents a history bf 
the network, a comparison between computer/ , 
assisted instruction and -^n format ion storage 
and retrieval, and a summary of the uses made 
of the CAI materials offered over the network. 



January l*i73 



February 1974 



March im 



April 1974 



Univcr:jitV of Illinois Medical 
Center , Chicago , connected 

Netv;ork users charf;t*d $2.50/ 
connect hour 

• .-^ ' 
University of Illinois' uiMi- 
draws from network ^ 

Portion of Illinois data base 
transferred to Ohio State com- 
p utor 



Packj; r ouncl 



r 



Sino^Jf'July 1^72, the Lister Hill National 
Center for Biomedical Communications of the y 
National Library of Medicine has nianaj;.ed an 
experimental t iriu-shar i nt; network for the 
inter-institutional sharin;: of bi o:iiedi cal com- 
puter assisted instructional materials. The 
key dates in the present and future history of 
the network are: 



July 1974 



June 1975 



Networkt,users cliarj;ed $5/con' 
nect hour 



Planned termination for 
network conf i ^;urat i on 



present 



i July 1972 Massachusetts General Hospital 

connected to network 



The dramatic growth in both number of 
users "^and in connect hours fs shown in the 
accompanying: praph. Tlic least squares fits 
used do tend to smooth th« rather marked , 
seasonal variations in use, corresponding, to 
the estivation/hibernation cycles of the using 
institutions. 



Sef)tembcr 1972 Ohio State University Colleg 
of Medicine connected 
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,V\'o\\\ lUv ber.inninj' <M* tlii: iiM^Avrk* iir.inr 
iiisLilutions hnvv bi-Mi i\<|uni»il lo prtn'iilj- 
thru <M.-ii Ir villi na I *; ^ pjv cn.sviun i t-.U i niv; cosl 
to llii' lUMrtT-t \u Lli».» lU'lwoik (.1 loi-al 
plinnr fiill [or tiio5ii^ in i\ iMly* lMit^i$in 
an luMu \\ llu-^iis*. r i.. in L*l.ih .unl lUi- !^;.u*i'*^t 
noclo in Caliiornia) inul assn'n tlie nccor.r.nry 
facility to use lIu' CM naLi'rials wi ll anil wise- 
ly, make periodic reports to tis and, D.V. , 
prepare additional units oi instruction. 
Faculty costs can Ijc extensive but have the 
advantaj»,e, froin bdlh the usinji institution's^^ 
and our point of view, that they can be buried 
in the institutional overheads, lerjninal, 
CCTimiuni cat ions , and connect -hour costs, on the 
otlicr hand, am new costs and our u:;in^ insti- 
tutiorts have had to adopt various in^'.enious 
expedients for meeting, and occasionally hid- — 
^n^, th^m. 

• We are' impressed^ rtnd .lascinaUMl by, ' » 
those wfio claim- CAT costs of less tlian $1 per 
terminal hour. We know our costs, and they 
arc soTicwhat hiKhor. At the peak of the net- 
work, \;hen all three computers were on line, 
they amounted to alnost $l^»/hour. The major 
portion of this, $IA.27 per hour, v;as a fixed 
cost for maintaining the data bases in the 
host computers, providing; small interface com- 
puters between eacli host computer and the net- 
work, and providing, for^ci prcat deal of 
interaction between the three university com- 
puter centers and their relatively naiye 
users. All of tlicse costs arc independent of 
usage » up to port saturation; 2,000 hours a 
month was used to arrive at the $14,27 fij^urc. 
D'e>ublinj; this usaj'.c would halve the costs and 
come uncomfortably close to s a turn tin;; the 
portSc (A port corresponds to a telephone 
number to the computer. A saturated port 
gives busy signals.) 

t Communications costs, based on the cost 
of lo-ging in to the-system and tlie number ;0f 
characters transmitted, are independent of 
distance. They are the same between two hos- 
pitals in Boston as they arc for a call from 
the University of Washinf;ton in Seattle to 
Columbus, Chip. The?ro costs are about $4,50 
per hojr, rcj»ardlcss of the number of hours 
used. It is these communication costs which 
wc are asking our users to share, and after 
July 1, 1974, assume. 

Th'- consol i rr-tM' '^^^ oT 'M*-? ^.i 
llu\ f to Lv.o cuin|)uL«. I S , v.hicii took place in 
April 1974, has resulted in some savins'.s, 
dropping the total costs to slirjitly under 
$14 per hour. The cost per student inter- 
action, based on two or three students clus- 
tered around a tcnninal and an averaj;e of 2.5 
lesson sessions per hour, jvivinK an avera^ie 
six student interactions p'*r hpur, is about 
$2.30 per student per lesson.^ 

' The true costs of the network are even 
Fiipher, since tiie above fij;ures make no pro- 
visions for amorti?iinj; the costs of develop- 
ing the data bases. These were created under 
Federal and, in one instance, state funding 
at a cost of perhaps $5 million. Our network^ 
has made possible the sharing of these data 



bases with a far wiiler ;nuHi\nei- than \.a:; on- 
j'inallv inleuiled but wi' have; not. hi-ru .i.l-i'd, 
fortunalrlY» to share tlu-se lieve I opMuni costs. 
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Most' ASIS members are mqru familiar lath 
on-line bi IvI i oy.raphic rctrii.'val systtn;,, such 
as' the Notional Library of MedicincS I'l'Ohr.E 
4/, than lhay arc with computer assisted in- 
struction, 'The similarities are ceniuoin:, 
.rather| t,\\)\t\ enli^;htenini% With bolli s'.st«.r.'o 
users 'sit at a terminal cqnnectcd to a cer.i- 
puter, hit keys, read printouts or (li^pia.s, 
at^l hit the keys a^^'un. Identical terminals 
can be used, for eitlicr. These terminals may 
well be loc a te d i n a - Ubr aryr 
clusr-.wts of student users tend to 'be noisier ' 
than ' run of the mill' library patron* 
Afte/ c the differences start to build up, 

^Operatinj' differences between tlie two 
types of on-line systems are ^ivcn in lable 1. 
The iiitellecti.al di f fr.»rences are perhaps evon 
^'.reater. They have been summarized by 
G« Octo Barnett : 

'*Thc CAI activity requires a hi^»h level 
of educational do^mitment on the pajt of the 
user, and is thus much more closelv related 
to classical clinical teacliing than it is to |^ 
the use of a library resource, 

"The user of the 0\L net.work does not 
hav*^ to have any sij;nificant knowled^!e of the 
field in ordiT lo use the systet.i proi iLa'^l" . 
Thus, the system attempts to teaclj in a verv 
active fardiion, rather than jur.t providing; 
pointers to an cducatioi^al resource. 

'*The CAI- network attempts to serve a much 
greater varieVy o-f uj^ers, varying from prac- 
ticing; physicians and nurses in comnunitv hos- 
pitals, to house .staff and fello\;s in teaching; 
hospitals, to medical students, and to a ^ide 
variety of paramedical personnel such as 
pliannacist^ ,• nurse practitioners, physician 

assistants, etc, 

\ 

"Because of the hi^.h der.rt^L* of ecura- 
tional content of the CAI network, it requires 
much closer contact and more intense inter- 
a-'fjoo:* lu t' ■ -1 lb t' r •> • • 
matter d^. velopei s, 'lliis prow.ram is naJiy in • 
a stag;e of rapid evolution and development, 
an^ it is obvious that evolution will occur* 
This would contrast to the on-line biblio- 
graphic services, which are fairly stable in 
regard to specifications and potcnl:ial 
users/' 2/ v 
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TAULIM . ^ I • 

COMI'AKISON OK CUMlirn:K ASSISTKI) INSIKUCTJON AM) ON-LINK HlULlOUKAPllI C SF.RVJCI'S 



1. 



2. 



3. 



U>i-i iiL^vJf; no journal, l)ook or ri'port 

Uju of terminal cannot' be dclcy^atcd, 
altbou^li it can be shared. Patron must 
use directly. i 

Self-instructional, UJ^er needs only to 
know liow to loj;-in, plus p.eneraj subject 
knowlcdt;c. Teaches actively. 



"Free-standint;," Tcfmxnals can be placed 
fcMjOnaximum user exposure, e.g., resi- _ 
'd5mrMloiiin;^f;~~aTTd"'day- rooms . 



5. User transactions arc ^'closed." At tiie 
^ end of sciitiioji iiscr need do no furtlier 

work, 

6. Portions, of the data bast- can be stored 
and modified in local co:nputer;; , 



On - I i nc^b i h i i tlil^ *112]^ ^ ser v i ces 
!♦ Ustr requires access to sourcos cited. 



2t Altlionr.1i u.s^^rs are ene^ra^.cd to make 

seavciies tiiemselvesj use can 'be del^ev\accd 
to trained searcher/^Milyst, 

Successful /ef f icient m^c* miiy r^guire irain- 



3, 
A. 



ing in searclun^; vocabulary /commands. 

Rcf|uires literature back-up. Terminals 
should be installed in or ni^ar li6rary<»^ 

5, User transactions are "open.'* At tlio end 
of trans»)ttion, user has further non- 
terminal work to do, such as look up 
furnished citations. 

6. Size of data base nnd bibi io^^raphic stand- 
' aids dictate central storaj;e with no user 

modi fi cat ions. 



Libraries, which may already have tennl- 
nals for- use with Mi:i)LlN>:, and wliich knov; how 
to file, retrieve, and not lo^s^ the associated 
visual mater ials-- =ioine OSU projtrams recjuire 
.35 mm slides or harti copy equivalents, MCI! 
pro^'.rams need easily" pilfefablc booklets of 
KCG strips--makc exceljiunt pliysical locations 
for the CAl activity. The educational commit- 
ment to whicli Dr, Barnett alludes--o co iinitment 
-A'hicii requires preparation of a u'^c -and evalu- 
ation p^a^i inte^.ration of the CAl materials * ' 
irito the curricuLmi and faculty cormiitments to 
preparo. addi tional units of instructions-is . 
more than the usual librarian can muster. 
When wc pointed thi's out to one librarian he 
§aid, *'Thank you," and returned the next week 
with his deani 

Librarians' or not, the network's contracts 
.with the usin); institutions aie m^-diated 
through individuals, who' require a peculiar 
mixture of the talents of spark plug, techno- 
logical gate keeper and plain, c Id- fashioned 
bird dog. These "users," our of^'ice short- 
hand for the network contact points, are a 
well-degreed lot^ A recent tabulation showed 

Sc.D. and M.p . , Ph.D. 

They live in a variety of academic de- 
partments. We checked the user list after the 
recent charging, flurry for survivors. We 
found the i-^ddresses givc\n in Table II; 

TABLE IT 

ACADKMIC HASi:S OK NKTWORK "USLKS" 



Clinical Departnents 

Medical Kducation Offices 

Li brar i es 

Coniputtr Centers 

Preclinical Departments 

Audiovisual Service Departments 



15 
13 
11 
6 
5 
2 



The exifilence of an "Office of Medical 
Kducati on"--*'V formal organi i^ati'bnal component 
devoted to uiiderstandinr, and improving, tlie 
tcach^(^g process , as contrasted with the impha- 
sis on teach in}'>* content characteristic of the ^ 
more traditional departments--secms to inilu- 
ence an institution's becoming a user of the 
network, wvw if the Office is not the oi'fi- 
al contact- point, U'e recently compiled a list 
of '"Offices of Mudie i! Kvhicat ion" fr(^i;i a stand- 
ard directory, J^/, and compared the institu- 
tions with our peak net\;ork users list, as of 
January 1974, Tlio result.-, are set forth ift 
the 2x2 contingency table**, be low; ^ 
• . "* - 

TABLE IIl^ 

INFLUENCE OF "OFFICES OF MEDICAL EDUCATION" 



Offices of Medical Education 
Listed 

. m YES 



(Users of the) 
(LnNCBC CAl) 
(Network) 



YES 



NO 



26 



28 



4A 



13 57 



1 • I 



This table gives a chi-squarc of 10,04, 1 
wl'.irh is sij.nificant at the. 0.005 levi^l, ^ 
apparently refhcting both the tendency of I 
institutions with Offices of Medical Education 1 
to become users of the n-twork, and for lliose" 
Institutions without such offices not to be- 
come users. 

Tiu: ysKs or the IiMitwuk k^ 

One of our "users," David A. Kronick, has 
written: "Anyone who sits at a terminal 
interacting with a computer based teaching 
program must feel the presence of another fi^c 
and active intelligonce who is using the 
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coupiUUi effective intcnnciliaiv, Mi\ 

llnis provitlinr. ^.r^ al^ r ixcvvar. to liir. rracliuij* 
skiUr./' J/» Tirtninnl i nU'rncl i oiu: .in* as 
ilifficMilt to .nMJv:'L! ;nul ilnssifv a;: arc maiv 
• otlior vaiiiMics of prol rat t nl , iiU i»r-piTsona i 
f!Uininl/ » In a i Uil it^tv! ti Mn;: mir CM pro- 
j;rams liavi* . rcportcLl tlu» fol lowinvt iif^*^*« : 

In troduction nf _CAJ^n ramiMjs^ A 
stt'inclnril scenario i-s tliat created by tlu' 
cntlmsiast twinu to; convince otlier faculty 
members of tlie ncrits of CAl/ They may liavo 
heard of it or lvimi witnessed a cU'oioiist rat ion 
at a nieetint;, but llav^ nrvcr before hM\ tbe 
opportunity of examining CM at leisure in 
their o\.*n offices, not over a foreiit of shoul- 
ders. Tlie jKtwork ;;ives boi:h faculty and 
students opportunity to test thii^ novelty 
in a, 1 ^1^11 ja r environment, 

b . C or.ij^UMn* nt to l oc al CAl ac tivities , / 
Another scenario. Professor X lias spen^ two . 
years ;.orkinK witli his local computer center 
to develop tlic sinj;lc perfect CAl proj'.rain. 
It's j:reat--alnost as yooi] as he r.ays--l)Ut 
it's the only one lie lias, and you can't make 
a neal out of apputi;'er'.. The j)ror,rams 
offered over the network can complement and 
contrast with his program, , 

c » R esource Vor oxptr imuntat i on in 
cducat ion . A standard pedagogical experiment 
is a comparison of teachinv; strategies and 
methods. The CAl netv.ork has made t possi- 
ble to import new teaching; methods ^without 
having to import or reproj^ram faculty members, 

<!• L^iliilLL£U» Kvaluation has at least 
i\;o najor a .pi.el One if, the Lvalualion of 
the naterit^ls Uunselvcs, \:liicli facullv loem- 
bers haVe tdheii to as j;lee ful 1 y 'as llu:y turn 
to coitinentinj* on other faculty members' text- 
bopks. The other is the use of some but not 
all of the pro|;rams to evaluate the computer 
assisted Lnstriictec. At least one of the 
National Uoavds is vigorously exploring, the 
use of terminal interactions to replace the 
tradi.tional , expensive, and not especiaTly 
reliable oral examinations, 

e, Cont_iniun,i; eHu cation . Althour.h wuy 
have few proj^rams desiined specifically to 

•meet the needs of the practicing physician, 
and none which have qualified to provide the 
necessarv contj^inine ecbiration rrpflii':, our 
ir.Lr*. li.iM ii^ur.O ih il i.fo .r.u .. i ler 

undergraduate and i;raduatc medical e(Uication 
can intore<;t and chalK'n^.e the person uhose 

-medical school days are far^. behind. The 
Dean of a medical school has told us that his 
most successful lectures tr^ doctors in prac- 
tice are the same that he y^iwf^ to his senior 
classes. The sarTie relationship seems to hold 
true for CAl cpurses. 

•» 

f • (feneratio n of niM ;. mater i a 1 s . 1 n 
times past, faculty members wishin;; to create 
CAl mntcria-ls have had to find a computer to 
use and perhaps learn or, wdrse, invent a 
proj;raf:riin^ lan^iua^e. The network has made it 
possible to writQ prop^rams in Kn^lish, with 
the remote computer acting; as ^:uide, tutor 
and editor. The format is, necessarily, . 



/ 

limited Iq/that of ilu* existinp, ptoeraras al- 
(hini;,huhe e<Milent differs. We have had a 
li\ii(i'd Micei in eneonia",i n>' Much aulh(M in^*. 
ihf biUl Irni'cl: has, all too often, bt.»ii.lhe 
reluclanci' of tin' host coinfuilor ci'nli rs to 
arcept :'Ueh pi o>:ra\;is and inte^^rate Hu m\ i.itli 
their own. ^ 

o » 

• H on^d i rec te d _nse . We ca 1 1 t h i s i li e 
"show and tell" mode; A terminal, with clear 
and unambij»uous instruction^ for its use and 
a trouble-shooter within call, l^i placed in a 
library or a rL .'..i dent s ' lonnp.o and its use 
ad ] i b i t inn uncoura['.t <l , just as one filaees 
b:ioks on ^l adiiM' tables. This metliod produces 
tnmi'ndous student enthusiasm, loj;s lotr. of 
hours of use but little in the way of usable 
reports. We know of at least two instances 
where the student* enthusiasm has pressured the ^ 
-"facTiliry Into t^kinr; computer assisted instruc- 
tic'n soriously. The students like CAl because 
;t lets them do their own thinj;, at tiieir own 
pace. 

h. Uemrdi a I use . One institution bail 
hoped to usu tiu' Uh * o State University v.rm s 
a n a 1 1 'in y s i' r; u e n e i • i r. a p a i r l* d c om p a r i s on of 
CAl vs. conventional teachinp,. Their termi- 
nals came too 'late for the planned experiment, 
but just in time to salva^^e lA students t.ho 
had been failing* j'ross anatomy. Use of G\T 
raised their j;rades to th.e middle of tin* class 
averav.e^^>trf^prvsent network costs make it 
difficult to compete wi tli ,c 1 assrooni teaehiup. 
on a cost basis but compare very favorably, 
both in cost and effectiveness, with individ- 
ual tutoviny*.. 

i. In t ejirat i v\\ ^ into th e eur r i c\i Imu / 
This has been a des i di rat uni .since th*-- !it in- 
ninp, of the network. With a few brllfianf; . 

Perceptions, it liQS not come to pass.. Curric- 
ulum revision takcis ?imc. Us i n^: i nst i tut i ons " 
are reluctant to commit themselves to depend^ 
ence upon what they rc^;ard, rijihtly or vron^dy, 
as a transient phenomenon. We liavi*, however, 
seen the transition from treatini; our CAl pro- 
j;r,ams as "recotinncnded reading;'' to makinu tiiein 
•'required reading," and the inclusion of speci- 
fic units in planned laboratory sessions, 

. TllE FirrURK OF TlU: NETWORK 

The medium. The past two years have 

...n.LLfl to l.ni>..,. iiiiDuL tiie probU-is invoiVvd in 
interconnecting; three computer centers, a 

.nation-wide t ine-sliar in>; network and as many 
as 80 usin^; institutions. The present con- 
fij'.uration is experimental and, like oilier 

"bread -boards , l reinendous ly eost-e f feet i Ve i f 
you i^;nore the orip.inal purchase price of the 
components and don't try to make it run for- 
ever, or make another one just like it. 
Unlike bib I i o;Toplu c stores, all of our data 
bases rlo not have to be kept on line at all 
ti'imcs to all prospective users. There must be 
methods of choppinj; off usefu/l subsets and 
shippiu); them off to local users, to use or 
modify as they see fit, without tyinp, up a 
transcontinental communication channel every 
time that a student wishes to use a proj^iam. 



4 



UV inlcml lo spend the next year lookin)i for 
sueb nu'lhods» * 

The noss.-r^r. The '-.atnf pjisl vcmts 
have raiij;hL us a K»"at uh-.i! about the ctniputer 
assisted instruction proj'rams on the niitwork. 
We occasional I V find time to jilance, covetous- 
ly, at CAI proj;rams in health sciences already 
written"buL' not on our network. These need to ° 
bo accMsloncd, evaluated, translated into 
so«ic standard form and niade avai lable for dfs- 
tribution. There is an even larjier donviin ol 
natcri'als v.hich need to be, but liave not, been 
written. Other agencies have specific mis- 
sions in fundinj; content development hut we 
feel that many useful things remain to be done 
in standardisation of formats and languages, 
^ in evaluatioa, specifically of tcachinv; strat- 
egies, in helpint; subject experts translate 
their skills into effective teachinj^; prof',rams 
and, on days for dreaminj; impossible dreams, 
tackling such sordid but unavoidable problems 
as author incentives and/or academic and fi- 
nancial recognition and remuncrAion. 
T 
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